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Background of the Invention 

10 1. Field of the Invention 

This invention relates generally to networking and more particularly to a method 
and apparatus for handling high data rates in a networking environment. 

2. Description of the Related Art 

Networking bandwidth has increased significantly and continues to enable higher 
15 data rates over networks. In fact, the increase in networking bandwidth has outpaced the 
concomitant increase in the processing capacity of processors receiving the data. The 
data provided to the processors over a distributed network comes into a host central 
processing unit (CPU) at a rate that is difficult for a single CPU to keep up with. 
Furthermore, the processing power of the CPU that is consumed for stripping and 
20 building data packets for receipt and transmission becomes prohibitive and causes delays 
for applications requiring CPU processing time. 

. Figure 1 is a simplified schematic diagram of a host system configured to receive 
Ethernet packets. Host 100 includes software stack 102. Software stack 102 includes 
Internet Small computer System Interface (iSCSI) layer, Transmission Control Protocol 
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(TCP) layer, Internet protocol security (IPSec) layer, and Internet protocol (IP) layer. As 
is generally known by those in the art, the software stack peels back the headers of a 
packet to receive the encapsulated data or builds up the packets for eventual transmission 
over network 108. Network interface card (NIC) 104 includes microprocessor 106 which 
is configured to receive and transmit Ethernet packets over network 108. 

One of the shortcomings of the design illustrated in Figure 1 is that a single host 
processor is responsible for performing the operations associated with software stack 102. 
Thus, as throughputs are continually being pushed higher, the single processor of the host 
is limited in the capability of supporting the throughput of the incoming data stream 
because of the built in latencies associated with the single processor of a host system. 
That is, the processor of the host can not consistently process the incoming data and 
execute routine processing instructions associated with a running application in a manner 
which limits latencies and at least supports the throughput of an incoming data stream. 
One solution to this shortcoming is to replace the single host processor with multiple 
CPUs on a board. However, this solution becomes prohibitively expensive, thus, 
multiple CPU's on a board is not an optimal alternative. In addition, due to the 
complexity of the processing occurring with respect to the networking application the use 
of a state machine is not feasible for the network processing. 

In view of the foregoing, there is a need to provide a chip optimized for 
networking applications to process data efficiently and cost effectively in order to offload 
processing from the CPU to free CPU time for other applications. 
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Summary of the Invention 

Broadly speaking, the present invention fills these needs by providing a processor 
adapted for networking applications that efficiently processes data packets and offloads 
5 processing from the central processing unit of a host system. It should be appreciated 
that the present invention can be implemented in numerous ways, including as a process, 
an apparatus, a system, or a device. Several inventive embodiments of the present 
invention are described below. 

In one embodiment, a networking application processor is provided. The 
10 processor includes an input socket configured to receive data packets. The processor 
includes a memory for holding instructions and circuitry configured to access data 
structures associated with the processing stages. The circuitry configured to access data 
structures enables a single cycle access to an operand from a memory location. An 
arithmetic logic unit (ALU) is provided. Circuitry for aligning operands to be processed 
15 by the ALU is included. The circuitry for aligning the operands causes the operand to be 
aligned by a lowest significant bit, wherein the circuitry for aligning the operand supplies 
an extension to the operand to allow the ALU to process different size operands. 

In another embodiment, a processor is provided. The processor includes an input 
socket configured to receive data packets. A memory for holding instructions and 

20 circuitry configured to access data structures associated with the processing stages are 
included. The circuitry configured to access data structures enables a single cycle access 
from a memory location. An arithmetic logic unit (ALU) is provided. The ALU is 
configured to receive a first and a second operand, where the second operand is specified 
from an internal register and the first operand includes a mask enabling the ALU to 

25 process a non-masked segment of the first operand. 
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In yet another embodiment, a processor capable of processing a data packet is 
provided. The data packet is associated with a processing stage of a pipeline of 
processors. The processor includes a data random access memory (RAM) configured to 
enable access to data structures. Instruction fetch and decode circuitry configured to 
interpret instructions to be executed by an arithmetic logic unit (ALU) is included. The 
instruction fetch and decode circuitry includes a read only memory (ROM), a code RAM 
and instruction decode circuitry. The ROM is configured to store code common to each 
processing stage associated with a pipeline of processors. The code RAM is configured 
to download code specific to the processing stage and the instruction decode circuitry is 
configured to recognize operating instructions. Execute and write back circuitry 
configured to set up operands to be processed by the ALU is provided. The execute and 
write back circuitry includes internal registers for defining a first and a second operand, 
an arithmetic logic unit for processing the first and second operand, and align function 
circuitry for aligning the first and the second operands to be processed by the ALU. The 
align function circuitry causes the first and the second operands to be aligned by a lowest 
significant bit, wherein the align function circuitry supplies an extension to each of the 
operands to allow the ALU to transparently process different size operands. 

Other aspects and advantages of the invention will become apparent from the 
following detailed description, taken in conjunction with the accompanying drawings, 
illustrating by way of example the principles of the invention. 
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Brief Description of the Drawings 



The present invention will be readily understood by the following detailed 
description in conjunction with the accompanying drawings, and like reference numerals 
designate like structural elements. 

Figure 1 is a simplified schematic diagram of a host system configured to receive 
Ethernet packets. 

Figure 2 is a high-level simplified schematic diagram of a network interface card 
(NIC) having the capability of processing multiple layers of a packet header in 
accordance with one embodiment of the invention. 

Figure 3 is a schematic diagram illustrating a configuration of pipelined 
processors for processing different stages of a received packet in accordance with one 
embodiment of the invention. 

Figure 4 is a schematic diagram illustrating the modules of the processor complex 
in accordance with one embodiment of the invention. 

Figure 5 is a high level block diagram of the components of a processor complex 
configured to efficiently process data packets in accordance with one embodiment of the 
invention. 

Figure 6 is a more detailed block diagram of the instruction fetch and decode 
circuitry and the execute and write back circuitry of Figure 5 in accordance with one 
embodiment of the invention. 

Figure 7 is a graphical representation of the two stage pipeline configuration for 
the processor complex in accordance with one embodiment of the invention. 

Figure 8 is a simplified schematic of the parallel paths through adder and shifter 
components of an arithmetic logic in accordance with one embodiment of the invention. 
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Figure 9 is a more detailed schematic diagram of the configuration of the shifter 
of Figure 8 in accordance of one embodiment of the invention. 
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Detailed Description of the Preferred Embodiments 



An invention is described for a processor optimized for network applications. 
The processor is configured to allow a single cycle access to a large address space while 
5 an align function allows the arithmetic logic unit (ALU) of the processor to process 

multiple width size operands by shifting and padding the operands so that different width 
sizes become transparent to the ALU. It will be obvious, however, to one skilled in the 
art, that the present invention may be practiced without some or all of these specific 
details. In other instances, well known process operations have not been described in 
10 detail in order not to unnecessarily obscure the present invention. Figure 1 is described in 
the "Background of the Invention" section. 

The embodiments described herein provide a processor configured to efficiently 
process incoming or outgoing packet data. In one embodiment, the processor is arranged 
in a pipeline architecture, where one or more of the processors may be associated with a 

15 certain stage of the pipeline. The processor pipeline offloads previous processing 

performed by a central processing unit (CPU) of a host system, thereby freeing the CPU 
for other processing to improve system performance. As will be explained in more detail 
below, the processor is configured to allow a single cycle access to a large address space. 
Figure 2 is a high-level simplified schematic diagram of a network interface card 

20 (NIC) having the capability of processing multiple layers of a packet header in 

accordance with one embodiment of the invention. Host 120 includes NIC 122. NIC 122 
is in communication with network 124 over an Ethernet line. Software stack 128 
includes internet small computer system interface (iSCSI) layer, transmission control 
protocol (TCP) layer, internet protocol security (IPSec) layer and internet protocol (IP) 
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layer. Here, software stack 128 peels back the headers of a data packet received by NIC 
122. Alternatively software stack 128 may build the data packets for eventual 
transmission over network 124. It should be appreciated that offloading the 
encapsulation and stripping processes of the data packets from host 120 to NIC 122 frees 
5 the host for processing associated with other applications. Furthermore, the pipelined 
configuration of NIC 122 allows for the encapsulation and stripping processes to be 
broken down into simple steps that concentrate on a particular segment of the processing 
to process the data efficiently. 

Figure 3 is a schematic diagram illustrating a configuration of pipelined 

10 processors for processing different stages of a received packet in accordance with one 
embodiment of the invention. As can be seen, each of the layers associated with the 
software stack, i.e., IP layer 128-4, IP SEC layer 128-3, TCP layer 128-2, ISCSI layer 
128-1, are defined as distinct stages. Each of the stages include at least one processor to 
manipulate the data received from or sent to each of the stages. Processors 148-1 through 

15 148-n make up the processing pipeline for the receiving side 146. Processors 150-1 

through 150-n make up the processing pipeline for the transmit side 144. Layers 128-1 
through 128-4 are located between link layer 130 and management layer 132. One 
skilled in the art will appreciate that link layer 130 provides the communication interface 
for an Ethernet connection, while management layer 132 provides the communication 

20 interface for the host layer 134. Management layer 132 includes management CPU 136, 
which is in communication with dynamic random access memory (DRAM) 138. Host 
layer 134 includes a communication interface with host CPU 140. CPU 140 is in 
communication with host memory 142. In one embodiment, each of the processors 148-1 
through 148-n and 150-1 through 150-n contain at least three memory regions in order to 

25 maintain a line throughput rate for a data stream being received or transmitted. It should 
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be appreciated that while a certain number of processors is shown in Figure 3 for each 
stage, any suitable number of processors can be included in each stage. That is, the 
number of processors associated with each stage is any suitable number of processors in 
order to build or strip the data packets for the next processor or next stage. It will be 
5 apparent to one skilled in the art that the processors illustrated in Figure 3 may be located 
on a printed circuit board and can be configured as a plug-in card. In addition, each of 
layers 128-1 through 128-4 may be referred to as pipeline stages. 

Figure 4 is a schematic diagram illustrating the modules of the processor complex 
in accordance with one embodiment of the invention. Each of the pipelined processors 

10 include input socket interface 160, star processor 162, output socket interface 164 and 
hardware accelerator 166. It should be appreciated that for pipelined processors the 
output socket interface of a first processor is in communication with an input socket 
interface of a second processor, and so on for each of the pipelined processors. In one 
embodiment, input socket interface 160 has two input ports, port A 168-1 and port B 168- 

15 2. Each of these ports consists of a 72-bit data bus, a 16-bit address bus (8 bits of address 
and 8 bits as byte mask) and handshake signals. Data from port A 168-1 and port B 168- 
2 is communicated to multiplexer 170. In another embodiment, a scheduling algorithm 
schedules port A and port B requests in a round robin fashion. Multiplexer 170 
distributes the packet data into three static random access memory (SRAM) locations. 

20 The three SRAM locations are represented by blocks 172-1 through 172-3. In another 
embodiment, SRAM regions 172-1 through 172-3 are single ported memories. The three 
single ported memories allow for the throughput rate to be maintained for an incoming 
data stream, while occupying a minimal amount of area on the chip surface. Each of the 
memories, also referred to as buffers, 172-1 through 172-3 are in communication with the 

25 parity verify in multiplex block 174. It will be apparent to one skilled in the art that the 
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parity verify and multiplex block 174 is a piece of hardware that verifies the parity bits 
appended to a message. Input socket interface 160 includes finite state machine 176. In 
one embodiment, when a request is forwarded to finite state machine 176, the finite state 
machine checks for space availability in the buffers 172-1 through 172-3. Here, a pointer 
5 points to the buffer that was last written to and if space is available in the buffer that was 
last written to, then this buffer is used for writing an incoming packet. In one 
embodiment, the buffer is used for multiple packets when it is determined that writing 
multiple packets to a buffer does not cause a delay in a subsequent reading operation. 
Input socket interface 160 of Figure 4, may be configured as a hold-off socket. 

10 That is, at times some data may come into the input socket that may need to access a data 
structure that is not in Data RAM 156 as the capacity of the Data RAM is limited. Thus, 
the data structure may be stored in external memory, such as dynamic random access 
memory (DRAM). If the associated data structure is not cached, then it will have to be 
fetched from the external memory. In order to prevent hold up of all the pipeline 

15 processing due to the data fetch, at least three buffers 172-1 through 172-3 are provided. 
In one embodiment, between 3 and 32 buffers are provided to maintain the line rate of the 
incoming data. 

Processor 162 includes read only module (ROM) 152, code random access 
memory (RAM) 154 data RAM 156 and registers 158. The instruction for the processor 

20 to perform its functions is held in the code space, i.e., memory, provided by ROM 152 
and code RAM 154. It should be appreciated that by dividing the code space into two 
parts allows for accommodating fixed code to be used in every stage of the pipeline of 
processors in one of the parts. Thus, common functions used by each processor of the 
pipeline are stored in ROM 152, which can be replicated for each processor at each stage. 

25 Examples of a common function include instructions for downloading specific microcode 
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for the pipeline stage and moving data between modules. Code RAM 154 contains the 
specific processing instructions for the functionality performed by the pipeline stage of 
which processor 162 is located. For example, processor 162 may perform specific 
functionality for the IPsec layer or one of the other stages described with reference to 
5 Figure 2. Thus, code RAM 154 would contain the specific processing instructions for the 
IPsec layer here. 

Data RAM 156 enables the processor to access different data structures. For 
example, a TCP connection behind a TCP packet is associated with a protocol and a data 
structure. The processor must access the associated data structure to process the TCP 

10 packet. Similarly, for the IP layers and the iSCSI layer there will be associated data 

structures that are fetched and written back from a suitable media or external storage. In 
addition, registers 158 provide temporary storage when writing microcode. In one 
embodiment of Figure 3, after powering-up, code RAM 154 does not have any 
meaningful data in it. Accordingly, processor 162 , upon power-up, will start executing a 

15 special system routine from ROM 152 which will initialize the first location of code 
RAM 154 with a jump statement to the right place in the ROM. 

Still referring to Figure 4, Hardware Accelerator 166, also referred to a Transform 
unit, transforms the data. For example, when doing iSCSI processing a data digest or 
cyclic redundancy check (CRC) must be computed. Here, hardware accelerator 166 

20 performs this function. Additionally, hardware accelerator 166 may perform some align 
functions. For example, the data packet may start at a certain offset at a first pipeline 
stage, but when the data is passed to a next pipeline stage it may be desired to start at a 
different offset, i.e., realign the data, as discussed in more detail below. In one 
embodiment, processor 162 communicates with input socket 160 to determine the data to 

25 be communicated to Transform Unit 166. Subsequently, processor 162 directs transform 
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unit 166 to perform processing as the transform unit moves the data. In addition, 
processor 162 may instruct transform unit 166 to move data from a first offset to a second 
offset, as well as specifying a particular transformation process. It should be appreciated 
that input socket 160, processor 162, output socket 164 and transform unit 166 are the 
5 modules of a processor complex that is replicated for each of the stages of a pipeline 

architecture, wherein the replicated processor complex can be customized for a particular 
stage. 

Figure 5 is a high level block diagram of the components of a processor complex 
configured to efficiently process data packets in accordance with one embodiment of the 

10 invention. It should be appreciated that processor complex 180 may be replicated a 
number of times to form a pipeline wherein certain processors of the pipeline perform 
processing operations associated with particular stages of the pipeline. For example, 
processor complex 180 may be used to process the various header layers at each of the 
stages as illustrated with reference to Figure 3. Processor complex 180 includes input 

15 socket 160, output socket 164, and hardware accelerator 166. As mentioned above, 
hardware accelerator 166 may also be referred to a transform unit. Also included in 
processor complex 180 are ROM 152, Code RAM 154, Data RAM 156, instruction fetch 
and decode circuitry 182 and execute and write back circuitry 184. Each of the above 
mentioned components of Figure 5 communicate through internal bus (IB US) 186. For 

20 example, in one embodiment IBUS 186 carries all signals that control the writes and the 
reads from all the memories associated with the processor complex. It should be 
appreciated that instruction fetch and decode circuitry 182 includes circuitry configured 
to perform instruction fetches and interpret the instructions to provide an arithmetic logic 
unit (ALU) with the functions to be performed. Execute and write back circuitry 184 



ADAPP223/MLG 12 PATENT APPLICATION 



includes circuitry configured to set up operands, process the operands through the ALU 
and write back the processed data. 

Figure 6 is a more detailed block diagram of the instruction fetch and decode 
circuitry and the execute and write back circuitry of Figure 5 in accordance with one 
5 embodiment of the invention. Instruction fetch and decode circuitry 182 and execute and 
write back circuitry 184a and 184b allow for the processor to be run as a two stage 
pipeline process. For example, with reference to Figure 7, a graphical representation of 
the two stage pipeline configuration for the processor complex is illustrated in accordance 
with one embodiment of the invention. Instruction fetch and decode operation (I) is 

10 executed during time period ti. As mentioned above, the instruction fetch and decode 
operation includes reading instructions from memory, such as ROM 152 or code RAM 
154 of Figure 6. The fetched instructions are then decoded by instruction decode 192. 
Then, during time period t2, execute and write back operation (II) is executed. Here, the 
operands are set up for the ALU, the ALU performs the processing and the data is written 

15 back. Simultaneously, the instruction fetch and decode operations for the next instruction 
is being performed during the second clock cycle, i.e., t2. It should be appreciated that if 
the processes from operations I and II were performed in one clock cycle, the amount of 
time to complete the operation would be unnecessarily long. In addition, the instructions 
would have to be fetched on the same clock cycle that obtains the addresses of the 

20 instructions. Thus, the processor could not run at high speeds. Accordingly, when the 
processor is configured to perform as a two stage pipeline, one instruction can be 
executed per clock cycle to optimize the performance of the processor. 

Returning to Figure 6, instruction fetch and decode circuitry 182 includes 
instruction decode circuitry 192, which is configured to receive data from ROM 152 and 
25 Code RAM 154. Instruction decode circuitry 192 is in communication with program 
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counter (PC) stack 190. Stack 190 is configured to call subroutines and enable the return 
to a defined point after execution of the subroutine. It should be appreciated that in an 
effort to keep the size of the processor to a minimum, the instruction set recognized by 
instruction decode circuitry is general and compact. In addition, the amount of 
5 redundancy is limited, therefore, in conjunction with the compact set of instructions, the 
size of the processor is minimized so that a maximum number of processors can fit on a 
single chip to perform the necessary network processing. Furthermore, the instruction 
memory size can be of variable size for each processor depending on the need for 
memory at each stage of the pipeline. TABLE 1 illustrates the organization of the 
10 instruction format for a 96 bit instruction in accordance with one embodiment of the 
invention. 



TABLE 1 



Instruction 
Bit(s) 


Meaning assigned for decode 


95:94 


In the case of a destination indirect operation these bits specify 
which one of the 4 available destination indirect registers to use 


93:92 


In the case of a source indirect operation these bits specify 
which one of the 4 available source indirect registers to use 


91 


When set, it loads the destination indirect address register with 
the final read address generated by the instruction. 


90 


When set, it loads source indirect address register with the final 
read address generated by the instruction. 


89 


Branch Instruction bias. When set it implies that the bias is in 
favor of the branch being taken. If reset, it implies that the bias 
is in favor of the branch not being taken. 


88 


Use the Destination Indirect address register to derive the actual 
destination address. 


87 


Use the Source Indirect address register to derive the actual 
source address. 


86:85 


Operand Size Specification. 

00 = Byte Operation, 

01 = Word Operation, 

10 = Double Word Operation. 


84 


The return bit 


83 


ALU instruction/external Instruction select 


82:78 


Instruction Op-code 


77:70 


2 nd Operand select. It is the byte address of the internal register 
that is specified as the second operand. The immediate operand 
address will be all l's. 


69:51 


Source Address 


50:32 


Destination Address/Jump address. When used as the jump 
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address bits 49:36 should specify the 14-bit jump address which 
is the value that should be loaded into the program counter. The 
other unused bits should all be O's. 


31:0 


Immediate Operand/Mask 



TABLE 2 illustrates the instruction set in accordance with one embodiment of the 
invention. Notes 1-6 below TABLE 2 are applicable to the corresponding instructions as 
defined in TABLE 2. It should be appreciated that operation codes 0x10 and 0x1 1 
5 include an "and" instruction combined with a "jump on zero" (JZ) or a "jump on no zero" 
(JNZ) instruction, which allows for completion of the operation in one cycle rather than 
two cycles for the separate instructions. 



TABLE 2 



Op-Code 


Instruction 


Notes 


0x00 


cmpj_gt 


1,2, 3,6 


0x01 


CMPJ_LT 


1,2, 3,6 


0x02 


CMPJ_EQ 


1,2, 3,6 


0x03 


LOOP 


1,2, 4,6 


0x04 


SUB 


1,3,6 


0x05 


ADD 


1,3,6 


0x06 


ADD_JC 


1,2, 3,6 


0x07 


ADD_JNC 


1,2,3,6 


0x08 


ADDC 


1,3,6 


0x09 


XOR_JZ 


1,2, 3,6 


OxOA 


XOR_JNZ 


1,2,3,6 


OxOB 


XOR 


1,3,6 


OxOC 


OR 


1,3,6 


OxOD 


SHR 


1, 3,6 


OxOE 


SHL 


1, 3,6 


OxOF 


AND 


1,3,6 


0x10 


AND_JZ 


1,2, 3,6 


0x11 


AND_JNZ 


1,2,3,6 


0x12 


CALL 




0x13 


JMP 




0x14 


LOAD 


5 


0x15 - OxlF 


UNUSED 




0x20 


GF_MULTI 


1,3,6 


0x21 


Hash 


1,3,6 


0x22 - 0x3F 


Unused 





ADAPP223/MLG 



Patent Application 



Note 1: These instructions may be specified with a .b or a .w or a .1 extension to 
indicate if the instructions are byte operations, word operations, or double word 
operations, respectively. It should be appreciated that Note 1 is associated with the align 
function discussed herein. 

Note 2: These instructions may be specified with a bias that is toward the jump or 
the next sequential instruction. Here, a clock cycle is saved by specifying a jump bias. 

Note 3: These instructions may specify either an immediate operand or a mask. 

Note 4: These instructions may specify only an immediate operand. 

Note 5: These instructions may specify only a mask. 

Note 6: These instructions can be specified with the return bit set, i.e., after the 
particular instruction is executed, the program counter will be loaded with the value at the 
top of the stack. It should be appreciated that there is not a separate return instruction, 
therefore, in order to return from a subroutine the return is specified within the instruction 
itself. Even a conditional jump instruction can have a return bit set where if a condition 
is not satisfied do the return and if the condition is satisfied take the jump. 

The instruction fetch and decode operating instructions include branch prediction 
capability which optimizes the time for processing. It should be appreciated that when 
performing pipeline processing it is possible that the instruction fetched is not the correct 
instruction for the branch. Thus, it is possible to take two clock cycles for a particular 
branched instruction rather than one. In order to minimize that occurrence, the 
microcode can specify which direction the branch is likely to take. Therefore, if the 
branch proceeds in the predicted direction there will be no extra latency. In one 
embodiment, NO OPERATION (NOP's) instructions are introduced in hardware to allow 
for blocking an instruction that was favored, i.e., predicted, but is not the instruction 
actually executed. One skilled in the art will appreciate that NOP's are instructions that 
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do nothing to insert an idle cycle or delay the next instruction by one clock. It should be 
appreciated that every conditional branch instruction will specify a bias either toward 
sequential execution or toward taking the jump. If a jump is taken in the biased direction, 
the conditional branch will complete in 1 clock cycle, otherwise the conditional branch 
5 will take 2 clock cycles. That is, conditional jumps may take an extra clock cycle if the 
non-biased branch is taken. In one embodiment, conditional jump instructions are 
provided as 2 operation codes with one operation code having instructions for favoring 
the jump and one instruction favoring sequential execution. In another embodiment, 
hardware NOP insertion will be performed by disabling the write-enable in the BBUS for 

10 an instruction that is pre-fetched but invalidated. PC Stack 190 will get loaded with the 
biased address and a delayed branch address register will store the non-biased address. It 
should be appreciated that the branch prediction microcode is stored in code RAM 154. 
In one embodiment, each branch instruction for each of the processors at each of the 
stages specifies the branch most likely to be used. 

15 In one embodiment, each instruction of the processor includes a source operand, a 

destination operand, and an immediate or an internal register operand. It should be 
appreciated that a source operand indicates a source location, the destination operand 
specifies the destination for storing the resulting value of the processing, while the 
immediate or the internal register operand performs some restriction on the source 

20 operand. It should be further appreciated that the configuration described herein does not 
require the instructions to be placed into a register in order to be operated on. That is, the 
operations are performed directly on data sitting in code RAM 154, thus, the data can be 
addressed and operated on in a single clock cycle. In other words, the embodiments 
described herein allow for a single cycle access from the SRAM. Code RAM 154 and 

25 Data RAM 156 provide a large addressable space to write to rather than an internal 
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register in conventional processors. It should be appreciated that src_indir (source 
indirect) register 194 and dst_indir (destination indirect) register 196, internal registers 
158a and 158b, and data memory SRAM 156 can all be specified as either a source or 
destination address of an instruction. The microcode SRAM 154 and output socket 164 
5 can be specified as the destination address of an instruction only, i.e. they are write only. 
Input socket 160 can be specified as the source address of an instruction only, i.e. it is 
read only. In one embodiment, src_indir register 194 and dst_indir register 196 are 
replicated multiple times. 

In another embodiment, only internal registers 158a and 158b can be specified as 

10 the second operand. Since internal registers 158a and 158b may appear in both 1 st and 
2 nd operand positions, the internal registers are duplicated as shown in Figure 6. Internal 
registers 158a and 158b are implemented as dual ported SRAM's with one write port and 
one read port so as to allow both read and write operations in every clock in this 
embodiment. Of course, internal registers 158a and 158b may be optionally addressed 

15 with a context register, so as to permit context switching between different processes that 
share the internal registers. As SRAM's (static random access memory) are being used 
for memory, the SRAM's can be single ported or dual ported. Therefore, for a single 
ported SRAM, there is a 1 clock penalty whenever an instruction that writes to the data 
memory is followed by an instruction that reads from the data memory. As is generally 

20 known, a single ported SRAM cannot perform both a write and a read operation in the 
same clock. 

It should be appreciated that the configuration of the processor components 
illustrated in Figure 6 allows for the specification of the width of the instructions, i.e., 
even if the processor and all the registers are 32 bits, the processor can operate on 8 bit 
25 and 16 bit wide operands. Here the various size instructions are designated by an 
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extension, such as the extensions listed with reference to Note 1 of TABLE 2. For 
example, in the case of a byte operation, the operand may be bits [31:24], [23:16], [15:8] 
or [7:0] of the data word. Thus, align function 198a, 198b, and 198c will multiplex these 
four possibilities into bits [7:0] of the ALU's operand. In the case of a word operation, 
5 the operand may be bits [31:16] or [15:0]. Bits [31:16] are connected directly as the 
ALU operand. Thus, a byte level operation, a word level operation or a 32 bit operation 
become transparent to ALU 200 through the align function. In one embodiment, the 
align function shifts the operands so that the operand is always aligned with the lowest 
significant bit for processing by ALU 200. Where an 8 or 16 bit operand is being 

10 processed the higher bits are filled with 0's or l's depending on the type of operation 
being performed. For example, with an addition operation it may be desired to fill the 
higher level bits with 0's. Thus, an 8 or 16 bit operand appears to the ALU as a 32 bit 
instruction. Of course, it is not necessary to shift a 32 bit operand. In summary, the align 
function shifts the operand and then extends the operand so that the operand appears as a 

15 32 bit processor to ALU 200. Optional block 202 is in communication with ALU 200 
and contains logic for executing special instructions, such as Galois field multiplication 
for ISCI cyclic redundancy check (CRC) computation or a hash instruction for 
implementing lookups. 

Two flags used with the processor of Figure 6 include a zero flag and a carry flag. 

20 The carry flag is latched to a flip flop, however, there is no storage information 

associated with the zero flag. That is, the zero flag information is automatically used 
with the information itself. Accordingly, there is no need to latch the zero flag since all 
the conditional instructions in the operation code (op-code) combine the operation that 
sets the flag with the checking of the flag. In one embodiment, the zero flag dependency 

25 from the adder path is eliminated, thereby enhancing the speed of the processing 
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executing over the adder pathway. In this embodiment the zero flag is now dependent 
only on the logical operations pathway. It should be appreciated that the carry bit is 
latched so that the carry bit may be used by a subsequent operation, such as an add with a 
carry instruction. 

5 The addresses for the different blocks in the processor's data memory (Data 

memory, I/P & O/P sockets, HAV accelerator, etc.) of Figure 6 can be split into address 
spaces that can be independently decoded. The independent decoding is achieved by 
assigning to each individual decoder an address space that is a power of 2, and choosing a 
starting address that is an integer multiple of the addressable space. For example, if there 

10 are 17 bits of address space for a 9 bit address, where bits 0-8 are assigned for the address 
bits while bits 9-17 can be used for selection of the data. Thus, the address is divided into 
two parts such that, the higher bits will be used to derive a block select for each block, 
and the decoding for the locations within the block is done with the remaining lower 
address bits. Of course, it is not necessary to implement as much memory as is provided 

15 by the address depth since there will gaps in the address space according to what is 
actually implemented. 

It should be appreciated that the Internal registers 158a and 158b, also referred to 
as accumulators, need to be duplicated because any of the processor (PRC) internal 
registers may be used as both the first and second operand, simultaneously. In one 

20 embodiment, both blocks will be implemented as a 32x32 register file with timing exactly 
similar to that of a synchronous SRAM. A bypass register is not needed for a register 
file, since there is no timing issue when the read and write address are the same on any 
clock. 

As mentioned above, a large addressable memory is an important feature of the 
25 processor. However, in order to minimize the size of the memory while providing a large 
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addressable memory, a single ported memory is provided. Accordingly, there is more 

memory space and less access logic as compared to a dual ported memory. In addition, 

the configuration of the two stage pipelining within the processor is balanced for the load 

being processed. More particularly, the instruction fetch and decode processing and the 

5 execute and write back processing are balanced. The load balancing has been achieved 

by partitioning of the logic so as to more uniformly re-distribute the delays along the 

critical paths of the two pipelined processes. An important part of this is the introduction 

of a synchronous SRAM for the data memory, I/P & O/P sockets. Use of a synchronous 

single ported SRAM will result in saving much of the address decode time and the 

10 routing time compared with a register-file implementation. The advantages gained with 

respect to power and density will also allow for the increase of the number of data 

locations to a large value. In turn, the increased data memory space also enables parsing 

all the received data without additional access delays. 

A mask feature is provided also for the embodiments of the processor described 

15 herein. As mentioned above, any instruction can include a first operand, a second 

* 

operand, where the second operand can be an immediate or an internal register operand. 
If the instruction specifies an internal register as the 2 nd operand, it may specify a mask to 
be used when operating on the 1 st operand. The immediate operand is part of the 
instruction itself, therefore, the immediate operand will take 32 bits of the instruction, 
20 i.e., for a 96 bit instruction width the immediate operand occupies 32 bits. If the 

immediate operand is not used in an instruction, then a mask may be used on the first 
operand. Where an internal register is used for the second operand rather than an 
immediate value, then the field for the immediate value is not used. The advantage of 
using a mask is that in the case of a packed data structure, the mask can be used to extract 
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and use specific bits from the operand. It will be apparent to one skilled in the art that the 
mask feature enhances the capability of the instruction. 

Source indirect register 194 and destination indirect register 196 are configured to 
enable a loadback feature within an instruction to automatically update the registers with 
5 a new offset value. The loadback feature defines the value by which register 194 and/or 
196 should be incremented as specified explicitly in the instruction itself. This can be 
accomplished without increasing the instruction width, since in an indirect operation the 
address is unspecified and so may be used to specify the offset value. Thus, the use of 
the offset enables random accesses using indirect addressing on every instruction after 

10 setting up the initial address. One skilled in the art will appreciate that in this 

embodiment, a source indirect operation cannot immediately follow an instruction that 
initializes source indirect register 194, and likewise, a destination indirect operation 
cannot immediately follow an instruction that initializes destination indirect register 196. 
It should be appreciated that the single cycle execution of the processor combined 

15 with the lack of an external agent interface and debug scheme found in other processors, 
eliminates the need for a state machine. Consequently, before a reset is removed, the 
program counter must be pointing to an already initialized section of microcode memory. 
Thus, a section of the microcode memory may be implemented as a ROM or it may be an 
SRAM that is initialized through the (Joint Test Action Group) JTAG chain. The 

20 program counter's reset value will also come from a register that is part of the JTAG 
chain. 

Figure 8 is a simplified schematic of the parallel paths through adder and shifter 
components of an arithmetic logic in accordance with one embodiment of the invention. 
Here, a 32 bit first operand and a 32 bit second operand are received by input alignment 
25 block 1 (AL1) 198a and input alignment block 2 (AL2) 198b, respectively. It should be 
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appreciated that alignment blocks 1 and 2 enable 32 bit adder 224 to process an 8 bit, 16 
bit, or 32 bit operand by the aligning the operand and extending the operand if the 
operand is less than 32 bits wide, as discussed with reference to Figure 6. For example, if 
the operand is a byte level operand which occupies the highest 8 bits of a 32 bit 
5 instruction, input aligners AL1 198a and AL2 198b, realign the 8 bits and extend the 8 
bits to a 32 bit instruction by adding O's or l's as described above. Parallel paths exist 
for the operands to be transmitted through shifter 226 and for logical operations 228. 
That is, the operands can either be transmitted through the pathway including adder 224 
or shifter 226. Of course, logical operations such as "or" operations, "and" operations, 

10 etc. would be transmitted through another parallel pathway. It should be appreciated that 
the critical pathway, in terms of time consumption, are the pathways for shifter 226 and 
adder 224. With reference to Figure 6, alignment blocks 198a, 198b, and 198c execute 
the alignment functionality referred to here. Returning to Figure 8, 3 to 1 multiplexer 
230 takes the output of shifter 226, adder 224, and logical operations 228 and transmits 

15 the appropriate signal, as determined by select signal 220, to output alignment block 3 
(AL3) 198c. It should be appreciated that the data transmitted to AL3 198c may be 
configured with the lowest bit in the lowest position. In one embodiment, when 
performing the write back of the result of the processing through the ALU, it may be 
desired to realign the result back to the 32 bit logical position in memory. It should be 

20 appreciated that the align function enables a 32 bit adder to be used here rather than 4-8 
bit adders where a carry flag is passed from each 8 bit adder. 

Figure 9 is a more detailed schematic diagram of the configuration of the shifter 
of Figure 8 in accordance of one embodiment of the invention. As described with 
reference to Figure 8, the shifter and adder paths are the most time consuming and have 

25 been configured to be independent of each other through the parallel configuration. The 
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embodiment described with reference to Figure 9 provides 4 multiplexers configured to 
shift incoming data in stages rather than using a 32:1 multiplexer. A 32:1 multiplexer 
would require much more space and the logic for the multiplexer would also be larger. 
The multiple stages of shifter 226 include multiplexer 240 where an incoming 32 bit 
5 operand is either shifted 16 bits or not shifted as determined by a select signal. That is, 
the select signal will specify to take a shift 16 value or a not shifted value. Next, the 
selected output of multiplexer 240 is input to multiplexer 242 and shifted 8 bits or the not 
shifted signal is selected as determined by a select signal. Then, the selected output of 
multiplexer 242 is input to multiplexer 244 and is shifted 4 bits or the not shifted signal is 
10 selected as determined by a select signal. The selected output of multiplexer 244 is input 
to multiplexer 246 and is shifted by 0, 1, 2, or 3 bits as determined by a select signal. The 
output from multiplexer 246 is then transmitted to multiplexer 230 and output alignment 
block AL3 198c as described with reference to Figure 8. 

In summary, the embodiments of the present invention provide a processor 
15 configured for networking applications. The processor evaluates packet headers and 

decides what processing is to be performed. In one embodiment, the processor is a 32 bit 
processor that is enabled to process 8 bit and 16 bit wide operands through an align 
function that makes the various size operands appear as having a 32 bit width to the 
ALU. It should be appreciated that the ALU as configured allows for improved timing 
20 performance. The layout of the ALU is optimized and made compact through pre- 
placement. In one embodiment, other instructions or logic, specific to the kind of 
processing that may happen in a particular processor, such as Galois field multiplication 
for ISCI CRC computation or a hash for implementing lookups, could happen in a 
separate block that could be attached parallel to the ALU. The decode for the instruction 
25 could be distributed so as to allow selection of the final result from the ALU or from the 
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customized block. Exemplary optional instructions include operation codes 0x20 and 
0x21 with reference to TABLE 2. 

The invention has been described herein in terms of several exemplary 
embodiments. Other embodiments of the invention will be apparent to those skilled in 
5 the art from consideration of the specification and practice of the invention. The 

embodiments and preferred features described above should be considered exemplary, 
with the invention being defined by the appended claims. 

With the above embodiments in mind, it should be understood that the invention 
may employ various computer-implemented operations involving data stored in computer 
10 systems. These operations are those requiring physical manipulation of physical 
quantities. Usually, though not necessarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, combined, compared, and 
otherwise manipulated. Further, the manipulations performed are often referred to in 
terms, such as producing, identifying, determining, or comparing. 

15 Any of the operations described herein that form part of the invention are useful 

machine operations. The invention also relates to a device or an apparatus for performing 
these operations. The apparatus may be specially constructed for the required purposes, 
or it may be a general purpose computer selectively activated or configured by a 
computer program stored in the computer. In particular, various general purpose 

20 machines may be used with computer programs written in accordance with the teachings 
herein, or it may be more convenient to construct a more specialized apparatus to perform 
the required operations. 

Although the foregoing invention has been described in some detail for purposes 
of clarity of understanding, it will be apparent that certain changes and modifications may 
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be practiced within the scope of the appended claims. Accordingly, the present 
embodiments are to be considered as illustrative and not restrictive, and the invention is 
not to be limited to the details given herein, but may be modified within the scope and 
equivalents of the appended claims. It should be appreciated that the claims do not imply 
5 any particular order of steps or operations, unless explicitly stated that an ordering exists. 

What is claimed is: 
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